Efficiency of discrete-time ratchets 
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Recently there has been much interest in discrete forms of Brownian ratchets, using a game- 
theoretic formalism. Using the approach pioneered by Parrondo, we develop a new method for 
obtaining the stationary probabilities and probability current for the case of discrete-time and 
discrete-space ratchets. We then use this result to calculate the Parrondian ratchet efficiency in two 
cases: firstly, for Parrondo's original system and, secondly, for a set of probabilities derived from a 
discretized ratchet potential. 
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Since the field of Brownian ratchets acquired its impor- 
tance, there have been numerous studies on the energetics 
of these microscopic devices P, . Parrondo Q devised 
a discrete-time and discrete-space version of the flash- 
ing ratchet model Q within a game-theoretic framework, 
and recent work has established the connection between 
game probabilities and physical variables that describe 
the motion of a Brownian particle ||. For extensive re- 
views of this area that show the relationship of the Par- 
rondo effect to classical random walks, quantum walks, 
fractal pattern formation and spin systems, for example, 
see :3] . The significance of game-theoretic approaches in 
physical systems has recently been reviewed p and the 
Parrondo effect in transport processes has recently been 
discussed 0. There is also emerging interest in the so- 
called continuous-discrete interface [8j , and the Parrondo 
approach is also of relevance in that arena. 

The original Parrondo's paradox involves the alterna- 
tion of two games. The first game, game A, has a winning 
probability given by p = ^ — e. It is easy to check that for 
e = game A is fair, whereas for small e game A turns 
into a losing game. Game B is a capital dependent game, 
where the winning probability depends on the capital of 
the player being multiple of three or not. If the capital is 
multiple of three the winning probability is p\ = jq — e, 
otherwise it is p2 = § — e. As in the case of game A, for 
e = game B is a fair game, and a losing one for e > 0. 
This set of probabilities can be summarized as, 

P= 2~ 6 ' Pl= 10- £ ' P2= 4~ e - (1) 
Parrondo conjectured that this system is a discrete form 
of the flashing ratchet, and this has recently been rig- 
orously demonstrated within a Fokker-Planck frame- 
work However, finding the correct formalism for 
describing the efficiency of the discrete ratchet and re- 
lating it back to the continuous case, has been problem- 
atic |l£| — this has motivated a solution, which is now 
presented for the first time in this paper. 

The flashing ratchet consists of a Brownian particle un- 



der the influence of a potential that can be switched on 
and off either stochastically or periodically. Its dynamics 
can be described through the following Langevin equa- 
tion, x = -V'[x(t)] ■ C(i) + i^oxt + D[x(t)] ■ where (i) 
accounts for white noise, (ii) is a form of dichoto- 
mous noise that switches on (state B) and off (state A) 
the potential V(x), and (iii) F ex t is a force acting on the 
particle, that can be exerted by an external agent. It is 
required that the potential has a certain degree of spatial 
asymmetry in order to obtain directed motion from these 
fluctuations. Usually a ratchet-like potential is used, 



V(x) = V 
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where Vo denotes the amplitude of the potential and L 
its spatial periodicity. Although other similar potentials 
perform the same task, Eq. Q is convenient for analyti- 
cal purposes. 

The corresponding set of Fokker-Planck equations re- 
lated to the Langevin equation that describes the tran- 
sitions of the particle between states A and B are 0], 
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where PA(x,t) (resp. Pb{x,i)) denotes the probability 
of finding the particle in state A (resp. B) at a given 
position x and time t. The term Lo a ^p accounts for the 
transition rate between state a and (3. The probability 
currents J a and Jb are given by 
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In the stationary regime we have PA{x,t) — Pa{x) 
and PB{x,t) = Pb(x). The current in this regime is 
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FIG. 1: State transition diagram between games A and B. 

constant Q and given by J = J A (x) + J B fx) ■ With this 
in mind, and using the same notation as in we propose 
a model that describes the dynamics of the capital of the 
player when alternating between games A and B. The set 
of Master Equations (ME) describing this process are 

P* A (t + 1) = (l-u AB )[aUP*i(T)+aiPf(T) 
+a\P A +1 (r)} + ^[t^^Wl^W 

+b\P t B +1 (r)} (3) 

P l B (r + l) = (l-u; BA )[bUPf-i(r) + biPf(T) 

+b\P? +x {r)] + cjABlaUP^ + alPfir) 
+4P&i(t)]. (4) 

The terms P a (t), P b (t) account for the probability 
that the player plays game A or B with a capital i at time 
r respectively. Also the term a l _ 1 (resp. b l _ x ) denotes 
the probability of winning if the player plays game A 
(resp. B) with a capital (i — 1); Oq (resp. b l ) is the so- 
called self-transition probability, that is, the probability 
that the player will remain with the same capital after a 
round played for a given capital i] and finally a\ (resp. b\) 
is the probability of losing when the player has a capital 
(i + 1) and is playing game A (resp. B). The transitions 



between game states are shown in Fig. ^ 

In order to preserve normalization, Eqs. fc must 
accomplish the condition ^2i[P A (t) + P B (r)} = 1 for the 
stationary probabilities, and a L ^ 1 1 +a} ) + a 1 ^ 1 = 1 together 
with b^ + b l + b l {~ 1 = 1 for the transition probabilities in 
games A and B respectively. Making use of the normal- 
ization condition for the transition probabilities, Eqs. © 
& Q can be rewritten in the form of continuity equations 
for P\{t) and P 1 b {t) as 

Pf(r + l)-P A (r) = (l-uj AB )[aUP£i(T)- 
(a'f 1 + ^ 1 )P a {t) + <AP a x {t)} - u, AB P A (r) + 
+co BA [bUP l B - 1 (r) + biP?{T)+b\P*+ x {T)] 

P B (r+l)-Pf( T ) = (l-U BA )[bUPf-l(T)- 

(6L+ 1 + b\- l )P B {r) + b\P B +x (r)} - u BA P B (r) + 
+u Jab [<S_ 1 P a x {t) + ^P a {t)+c? x P a x {t)] 

where the Ihs of both expressions must equal zero, in 
the stationary regime. These equations, combined with 
the normalization condition for the stationary probabili- 
ties, form a set of equations that must be solved for the 
variables P A , P B for each i. For the case of Parrondo's 
games it is necessary only to consider the 0, 1 and 2 states 
due to the presence of a modulo three periodicity. There- 
fore, in matrix form we must solve the C ■ P = U, where 
P = {P A , P A , P A , P B , if, P 2 B } T , U - {1, 1, 1, 1, 1, 1} T , 
and 
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1 + ui BA p B 1 + LO BA r B 

l + (l-u BA )q B l + {l-w BA )p B 

1 + (1 - uj BA )p b 1 - B x - lj ba 1 + (1 - 0J BA )q B 

l + {l-cu BA )q B l + {l-u BA )p B 1-B 2 -uj ba J 



and where A, = (1 — uj AB )(pf + qf) and B t = (1 — 
co BA )(pf + qf)- The solution can be obtained through 
P = C" 1 -U. The analytical solutions for P A and P B are 
too lengthy to be presented here — however, we will show 
some results concerning the original Parrondo's games A 
and B. As we already stated before, these games are al- 
ternated using a mixing probability 7. This means that 
independently of the previously played game, we have al- 
ways a probability 7 of playing game A and a probability 
1 — 7 of playing game B, in the next round. It can be 
easily checked that the latter condition is equivalent to 
uab = 1-7 and lob A = 7. 

Making use of the previous expressions for lo ab , lo ba 



together with the set of probabilities already defined in 
Eq. J3J, and by letting r) = -169 + 11 7 2 + 16 e - 240 e 2 - 
2 7 (11 + 8 e), we obtain the following expressions for the 
stationary probabilities for game A and B 
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where r/ 2 = (13 + 7 2 - 8e + 16e 2 + 2 7 (-1 + 4e)) , 
773 = (-13 + 47 2 - 6e-40e 2 + 37(-7 + 2e)) and 774 = 
(-39 + 4 7 2 - 6e - 40e 2 + 7 (5 + 6e)) 

They are expressed in terms of the mixing probability 
7 and the biasing term e. In Fig. |2Jwe plot both station- 
ary probabilities P A , P B versus the mixing probability 7 
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FIG. 2: Plot of the evolution of the stationary probabilities 
for game A and game B versus the mixing variable 7. The 
inset shows that the sum of both probabilities, Pf = P/ 4 + 
P; S , agrees with the expressions obtained for the stationary 
probabilities IIo, ITi, II2 obtained for the mixed game AB. 

for the simplest case e = 0. The inset in Fig.[2]shows the 
total probability Pf = P^ + for each state, that is, 
the probability of finding the capital of the player mod- 
ulo three (Pq , P± , P;f) considering both games A and 
B. These values are compared with the stationary proba- 
bilites llo, Hi, and II2 obtained thr oug h a Discrete-Time 
Markov Chain (DTMC) analysis [lj. Fig. g] confirms 
that both probability sets fully coincide. 

The total current, as in the continuous case, will be 
constant in value (that is, independent of capital i), J = 
Jf + Jf, where = pf ■ PA - qf +1 ■ P t A +1 and Jf = 
pf ' PP ~ iF+i ' Pi+i- For obtaining the average gain, we 
must multiply the current J with the periodicity M of 
the games, which in our case is M = 3, and so G = 3 J. 
Simulations reveal excellent agreement with a theoretical 
plot of G versus 7. 

Now we have a method for obtaining the stationary 
probabilities P/^, Pf, we turn to the problem of evalu- 
ating efficiency for our discrete-time system. But firstly, 
we introduce a result from ||, where a method is pre- 
sented for obtaining a potential, given a set of proba- 
bilities defining a game. Its most important property is 
that the potential obtained is unbiased if a game is fair, 
and biased otherwise (with a positive slope if the game 
is losing and negative if winning). The equation used for 
calculating the potential is, 

i / Pj-i \ 

3=1 \ l-r-j / 

It can be checked that if our probability set 
{Pi>P2, ■ ■ ■ ,Pl-i} describes a fair game, that is, 
rii=i Pi — Tii=i 1i> then the potential is periodic Vq — 
Vl- It also works the other way around. If we have a 
discretized potential Vi, and we are interested in obtain- 
ing its related probabilities, we can make use of Eq. Q 
solving for the probabilities {pi, ri,qi} (see Q for further 
details). 



This previous result allows us to evaluate the efficiency 
in two different cases. On one hand, given two probabil- 
ity sets defining games A and B, we will obtain their 
related potentials using Eq. J7J) and then the efficiency 
can be derived. On the other hand, we can calculate the 
efficiency given two potentials, from which we can obtain 
their respective probability sets inverting Eq. J7J. For 
the latter case, we use a fiat potential for state A, that 
is, Va = 0, and state B, Vb will be obtained from Eq. @ 
with L = 3. 

In ^lj a new expression for the efficiency is presented. 
It is based on a new definition of the energy output £ ou t : 
'. . . We define the energy output £ ou t of an engine as the 
minimum energy input £- m required to accomplish the 
same task as the engine.' The novelty of this definition is 
that permits the evaluation of the efficiency for a Brow- 
nian particle even in the absence of an external load F. 
So we can evaluate the energy output (or V ou t) using 
the expression, V out = P™ 11 = F ext • v + -fv 2 . Recall- 
ing that in our system, v — J ■ L and 7 = 1, we obtain 
Pout — F ex tJL + J 2 L 2 . This is the equation to be used 
for determining the energy output of our system. 

The energy input of the system is the energy that we 
must supply to the system when switching between the 
two potentials. For evaluating this energy input in our 
system we need a potential related to each of the two 
games. Therefore, if we are dealing with probabilities 
defining our games A and B, we will make use of Eq. Q 
for obtaining the potential for each game. The energy 
input can be calculated theoretically by means of a prob- 
ability flux balance. In the stationary regime, the net 
flux from a given game, say game A, and state i, towards 
the other game B and the same state i can be calculated 
through the difference equation Jj^g(i) — J^_ 1 — Jf = 
(ptxPtx ~ tfPf) - (pfPf ~ Q&iP&i)- Clearly the net 
current J^(z) equals the opposite current from game B 
to game A, that is, = I^WI, where Jg^(«) = 

jf — Jf_ x . The input power can now be obtained and is 

given by P input - £f _1 J%{i) ■ (V B (i) - V A (i)). For the 
simplest case when F oxt = 0, for the original Parrondo 
games, we obtain 77 = 1.1078 ■ 10~ 2 for 7 = 0.36. For the 
alternation with the potentials Va and Vb, we obtain a 
maximum value for the efficiency of 77 = 1.061 ■ 10 -3 when 
7 = 0.35. The system possesses a low efficiency mainly 
because it works in an irreversible manner, far from its 
equilibrium state. The magnitude obtained for the effi- 
ciency agrees with other studies for the on-off ratchets 
P, 0| . Now that we have obtained an efficiency met- 
ric, it now provides a basis for comparing different Par- 
rondian or discrete-time ratchets, and provides a basis in 
the search for higher efficiency systems. 

Now we evaluate the efficiency, when F GXt ^ 0, which 
is difficult when considering alternation between games 
A and B. Clearly, the applied external force F ext must 
bias the potential with a slope equal to —F cxt . Whereas 
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FIG. 3: Plots of the efficiency versus the external forcing F e *t 
for two cases: a) Alternating the original Parrondo's games A 
and B with different mixing probability 7. From top to bot- 
tom: 7 = 0.4, 0.2, 0.6, 0.8. b) Alternating between the poten- 
tials Va = and Vb for a value of 7 = 0.45. The plot includes 
the curves for different values of the amplitude Vo for the po- 
tential Vb, from top to bottom: Vo = 0.45, 0.4, 0.35, 0.3, 0.25. 
For both graphs the theoretical curves are the solid lines and 
the numerical values are the circles. 

it can be demonstrated that the biasing parameter, e, 
introduced earlier in Eq. is exactly equivalent to F cxt 
only for the case of game A — due to the non-constant 
values of the probabilities in case of game B, e is no longer 
equivalent to the force. 

Because of this, we proceed as follows: given a set 
of probabilities {pi,r,i,qi\ defining our game B, through 
Eq. J7J we calculate its discretized potential Vi- Then, 
for F cxt / we add this extra bias through V { ncw = 
Vi — F cy r t -i, where i denotes the state. Finally the new set 
of probabilities will be obtained inverting Eq. {7J), using 
the new values for the potential {pf, rf, qf}. If we want 
to calculate the efficiency when alternating between the 
potentials Va and Vb, we need only to add the slope to 
these potentials and then invert Eq. Q) for obtaining the 
probability sets. In Fig. the efficiency for the original 
Parrondo's games is evaluated for different values of the 
mixing probability 7. It can be appreciated that the 
efficiency attains a maximum value for a value of f e xt 7^ 
0, that corresponds to a lower value for the current than 
in the case of F ext = 0. This effect also has been found in 
other models, for example in |l3j |. In Fig.|3h> we compare 
theoretical and numerical simulations for the efficiency 
when alternating between the potentials Va and Vb ■ We 
have obtained the efficiency for different values of the 
potential amplitude Vq for the potential Vb- As in the 
previous case, the efficiency also attains a maximum for 
a value of F cxt ^ 0. 

In conclusion, for the first time we provide a method 
that permits an analytical solution for the stationary 
probabilities Pf-, P?, and the average gain G = 3 J of a 
player that alternates between two games A and B with 
different transition probabilities luab, ^>ba- Using this 
approach, we then evaluated the efficiency in the case of 
the original Parrondo games, as well as for a given set of 
potentials Va, Vb, both of them sharing the essential fea- 
tures with the continuous model of a flashing Brownian 



ratchet. 
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